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Abstract. The paper reports on the improved Mainz experiment on tritum (3 spectroscopy which yields 
a 10 times' higher signal to background ratio than before. The main experimental effects and systematic 
uncertainties have been investigated in side experiments and possible error sources have been eliminated. 
Extensive data taking took place in the years 1997 to 2001. A residual analysis of the data sets yields for 
the square of the electron antineutrino mass the final result of m^(i'e) = (—0.6 ± 2.2stat ± 2.1syst) eV^/c*. 
We derive an upper limit of ■m(ve) < 2.3 eV/c^ at 95% confidence level for the mass itself. 
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1 Introduction 



In recent years observations of atmospheric, solar and re- 
actor neutrinos PI2|2H51|BlI7||Slini in large underground 
detectors have discovered and established strong mixing 
among the 3 neutrino generations I'l, U2, fs produced 
in weak decays. The mixing manifests itself in neutrino 
flavour oscillations whose wave numbers are proportional 
to the differences of the squared masses Amfj =| m?{vi) — 
m?{vj) I of the mixing generations. Neutrino flavour eigen- 
states Uf., v^, Vt produced in weak interactions with elec- 
trons, muons or taus are thus connected to the mass eigen- 
states ^1, 1^2, through a unitary mixing matrix V . So 
far oscillations v^. — > Vu_ and Vu_ — > v-r have been observed 



10-5 eVVc^ 



< Am 

'-23 



< 



yielding mass differences 5.5 

1.9 • 10-4 eVVc^ and 1.4 • lO'^ eVVc^ < Am^g < 6.0 
10"^ eV^/c'', taken from a recent combined analysis of 
oscillation parameters ^Ol • 

The fundamental discovery of finite mass differences 
between neutrino generations has re-stimulated the ques- 
tion about their absolute scale which is left open by any 
kind of interference experiment, necessarily. It could range 



^ This paper comprises principal parts of the PhD thesises 
of Christine Kraus, Beate Bornschein and Lutz Bornschein. 
^ corresponding author: e-mail: Ernst.Otten@uni-mainz.de 



from a hierarchical ordering with m\ or being much 



smaller than eitlier of the measured Ay 



values to a 



quasi degenerate situation where these differences are sit- 
ting on a much higher socket rv? ^ Am^^ (see e.g. JO]). 
Assuming m\ k, Q eV/c^, the former case would yield 
7712 ~ V'Arof^ « 0.01 eV/c^ and TO3 ^ \/Ato|^ « 0.05 
eV/c^. An experimental hint towards a degenerate solu- 
tion came recently from a reanalysis TLT, 12 of earlier, and 
from new data of the Heidelberg Moscow experiment on 
neutrinoless double (3 decay of ''^Ge. If due to virtual emis- 
sion and reabsorption of Majorana neutrinos the observed 
rate would correspond to a so-called effective neutrino 
mass 

m,,=|^m(^,)|L/,, pe^-^M (1) 

in the limits 0.1 eV/c^ < ruee < 0.9 eV/c^ (99.7% C.L.) 
|12| . The (j) are phase factors of the mixing matrix U. Al- 
though based on a 4cr signal, this decay mode could still 
be modified by the exchange of some other non-standard 
particles. 

Since in the universe a huge amount of about 336 relic 
neutrinos/cm'^ are supposed to be left over from the Big 
Bang, a sufficient rest mass could play an important role 
in the total mass balance, in particular as so-called hot 
dark matter during the early phase of cosmic evolution. 
Here the fine granulation of fiuctuations, observed in the 
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temperature of the cosmic microwave background (CMB) 
as well as in the large scale structure of the distribution 
of galaxies (LSS), constrains the neutrino mass. Com- 
bined analyses of recent surveys yield upper mass lim- 
its of 0.23 eV/c^ or somewhat more conservatively 
0.33 eV/c^ [TmT3] assuming 3 degenerate neutrino gener- 
ations. Another analysis quotes a finite mass of ~0.2 eV/c^ 
even [TBj . Still there is a caveat in this kind of analysis: 
it results from fitting a parametrized cosmological model 
in which 95% of the gravitational potential have to be 
attributed to unknown sources of matter and energy. 

From the above discussion we conclude that a model 
independent, absolute mass measurement is indispensable 
even if the sensitivity limit of alternative, model depen- 
dent methods is not reached yet. 

Among the model independent measurements, the in- 
vestigation of the (3 spectrum of tritium near its endpoint 
has yielded by far the most sensitive limits on the neu- 
trino mass (strictly speaking the mass of the electron an- 
tineutrino) in the past. Until the early nineties magnetic 
(3 spectrometers prevailed (reviewed in pntT^ I: thereafter 
electrostatic filters with magnetic adiabatic coUimation 
(MAC-E-Filters) took over thanks to their higher trans- 
mission and resolution (reviewed recently in |19II20| 1. They 
were proposed and realized independently in Mainz 
and Troitsk Our spectrometer yielded first results 

in 1991 from which we have extracted an upper limit 
of m{ve) < 7.2 eV/c2 (95% C.L.) |2S1; it improved to 
5.6 eV/c^ at the end of phase I of this experiment |2f)j . 
These early results still suffered from small spectral dis- 
tortions farer off the endpoint with a tendency to draw the 
observable m'^{i'e) into the unphysical negative sector the 
more, the farer the spectral interval, used in the analysis, 
was extended below the endpoint. 

After the reason for this effect had been identified, we 
performed in the years 1995-97 a substantial improvement 
program. It solved not only that problem but also im- 
proved the signal to background ratio by a factor of 10. 
In 1997 we started phase II of running, yielding in the 
first year a limit down to 2.8 eV/c^ (95% C.L.) [2Z| which 
was published in parallel to a 2.5 eV/c^ limit (95% C.L.) 
from Troitsk [2H|- In the second year of data taking our 
value improved to 2.2 eV/c^ (95% C.L.), communicated in 

■ This limit was obtained from the experimental result 
m^(z^e) = (— 1.6± 2.5stat ± 2. lays) cV^/c"'. In the present 
paper we are giving a final report on this experiment, its 
analysis and its results. 

The paper is organized as follows: In section 2 we re- 
sume briefly the principle of the experiment and discuss 
its sensitivity. In section 3 we describe the improvement 
program carried out for phase II. In section 4 we report on 
the data taking periods in the years 1997-2001. The data 
are analyzed and discussed in section 5. In section 6 fol- 
lows a discussion of the results. Conclusions and outlook 
are given in section 7. 



2 /3-spectrum and neutrino mass measured by 
an integrating electrostatic filter. 

2.1 /3-spectrum in T2 decay 

Since we observe only the kinetic energy E of the f3 particle 
we are measuring actually a sum of /3 spectra, leading each 
with probability Pi to a final state of excitation energy Vi 
of the daughter and with probability \Uej\'^ to a neutrino 
mass eigenstate m{i'j). Hence the differential decay rate 
(Fig.l) is 

§ = iV^cos^(e.)|MPF(i.,Z + l). 
p{E + TOec') J2 P^(^o -V,-E)- 

\U.^,\^^{E,~V.~Ef~m^{v,)c^ (2) 

Here N is the number of mother nuclei, Gf the universal 
Fermi coupling constant, 0c the Cabibbo angle, M the 
nuclear decay matrix element, F{E^ Z-1- 1) the Fermi func- 
tion, p the electron momentum, me the electron mass and 
i?o the Q value of the T2 decay minus the recoil energy of 
the daughter. Eq marks the endpoint of the /3 spectrum in 
case of zero neutrino mass. For the decay of molecular T2 
to the groundstate of the daughter molecular ion (•^HeT)+ 
one derives from the most precise direct determination of 
the mass difference m(T)-m(3He) = (18590.1±1.7) eV/c^ 
30^ an endpoint energy of £;o=(18574.3±1.7) eV ^ by 
taking into account the effects through recoil energy and 
apparative effects^. This is in good agreement with |25| . 

With respect to the required energy resolution, this 
rather low endpoint favours the choice of tritium. More- 
over, the minimal number of electrons in the daughter 
molecule facilitates the precise calculation of its excita- 
tion spectrum {Pi^Vi) in (3 decay. Another advantage of 
tritium decay is its superallowed character with a matrix 
element as large as M= 5.55 This leads to a reason- 
ably short half life of 12.3 a and high specific activity of 
about 3 MBq per cm^ and monolayer from a frozen T2 
source, in use here. 

The Fermi function can be approximated by j31| 

F= -• (1.002037- 0.001427 •Wfl/c) (3) 

1 — exp (— x) 

with x=27r(Z + l)a c/vp, a— fine structure constant, vp — 
velocity of the /3-particle. Radiative corrections to the 
(3 spectrum are been applied .32,33). However, they are 
rather small within our present accuracy limits, they give 
rise to a shift of m?{ve) of a few percent of our total sys- 
tematic uncertainty. One may also raise the point whether 

^ The apparative effects are a combination of electric po- 
tential depression, work functions from substrate and electode 
system and polarization shift. In the given references |24I25| 
the notation Eq represents the difference in the electrostatic 
potential of the point the electron starts on the source and 
the point it crosses the analyzing plane, which we will later 
describe as eUo (see Table 1). 
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contributions from right handed currents might lead to 
measurable spectral anomalies 0^ . We have checked that 
the present limits on the corresponding right handed bo- 
son mass inni rule out a sizeable contribution within our 
present experimental accuracy [201 ■ The excitation spec- 
trum {Pi, Vi) of the daughter (^HeT)+ has first been calcu- 
lated by Kolos, followed by a number of refined numerical 
calculations, e.g. ^|. We are using here the most recent 
ones by Saenz et al. |2H1. The excitation spectrum is shown 
in Fig. 121 The first group concerns rotational and vibra- 
tional excitation of (■^HeT)+ in its electronic ground state; 
it comprises a fraction of Pg=57.4% of the total rate. Its 
mean excitation energy is 1.73 eV for a /? energy close to 
the endpoint. The same amount of recoil energy goes into 
the center of mass motion of the molecule and is consid- 
ered already in the Eq value given above. In solid T2 the 
recoil may excite some phonons in addition. But in sudden 
approximation, which is quite valid here, the mean overall 
recoil energy will even then - for a P energy close to the 
endpoint - remain at 3.76 eV, which is the ballistic energy 
the decaying nucleus would receive in classical mechanics. 

After this first so-called elastic group we observe an 
important gap in the spectrum up to the first excited elec- 
tronic state of (■^HeT)+ at 24 eV. This gap could in prin- 
ciple be filled by a He -I- T+ continuum which starts at 
the dissociation energy of 4 eV. But dissociation on the 
cost of the f3- energy is strongly disfavoured in the Born 
Oppenheimer approximation. At 30 eV the first electronic 
continuum opens up in which we observe still strong reso- 
nances until complete ionisation is achieved in the second 
continuum beyond 80 eV. 

In solid T2 the sudden appearance of an additional 
nuclear charge may also excite a neighbouring molecule. 
Kolos et al. PH] have calculated the chance of this spec- 
tator excitation to be approximately 5.9% which is taken 
into account with some modification (see also section lE^ . 



2.2 Sensitivity of the /3-spectrum to vn?{ue) 

The last 2 terms in (jSJ are the total energy Ei, and the mo- 
mentum pu of the neutrino. They represent the neutrino 
phase space and give rise to the parabolic increase of the /3 
spectrum below E^ for vanishing neutrino mass, shown in 
Fig- n by the dotted and dashed line. The solid line shows 
the effect of degenerate neutrino masses m{vj) = m{Vf,)= 
10 eV/c^. In case of the dashed and the solid line only the 
decay into the electronic ground state of the daughter is 
considered. For m{ve)= 10 eV/c^ the missing decay rate 
in the last 10 eV below Eq is a fraction of 2-10"^" of the 
total decay rate, scaling as m^{ve)- 

We learn from these numbers that the tiny useful high 
energy end of the spectrum is threatened by an enormous 
majority at lower energies. However, it can be rejected 
safely by an electrostatic filter which can be passed only 
by electrons with a kinetic energy E larger than a poten- 
tial barrier qU to be climbed. Any momentum analyzing, 
e.g. magnetic spectrometer cannot guarantee this strict re- 
jection since scattering events may introduce tails to both 
sides of the resolution function. 
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Fig. 1. Tritium /3 spectrum close to the endpoint Eo. The dot- 
ted and the dashed line correspond to m(ue) — 0, the solid one 
to m(i'e) = 10 eV/c^. In case of the dashed and the solid line 
only the decay into the electronic ground state of the daughter 
is considered. For m(i/e)=10 eV/c^ the missing decay rate in 
the last 10 eV below Eo (shaded region) is a fraction of 2-10~^° 
of the total decay rate, scaling as m^(!/e). 
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Fig. 2. Excitation spectrum of the daugther ("^HeT)^ in /3- 
decay of molecular tritium 



Actually, the m(j/e) relevant signature of the spectrum 
extends further below the shaded triangle of missing count 
rate in (Fig. ^ into the region where m(i/e) causes an 
asymptotically constant offset. Let us investigate this for 
a sharp filter which integrates the spectrum for energies 
E > \qU\. For short intervals we may treat all factors in 
front of the sum in 10) as constant. In this interval it is 
sufficient to consider only the dominant decay mode into 
the electronic ground state (Fig. We then obtain the 
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integral count rate 



RiE) 



3 



AE' 



^CrY. |C^e,f ((^0 - Ef m\v,)c'f^ + b 

3 

= S + b 



(4) 



where b is the background rate, supposed to be indepen- 
dent of the filter setting and Cr is a specific signal rate. 
Under practical conditions the signal rate S integrated 
over the measurement time t separates from the back- 
ground noise \/bi only at distances Eq — E considerably 
larger than the sensitivity limit on the mass. There we 
may develop I^J to first order 

R{E)^CR{{E,-Ef~\{E,^E)Y,\U.,\''m\v,)c') + b. 

3 

(5) 

Besides the leading cubic term this approximate integral 
spectrum displays a product of the interval length (Eq—E) 
and a weighted squared mass 



El 

3 



(6) 



which is our observable. Hence we call the square root of 
jnj the electron antineutrino mass m{ve) (see also |2()|'l. 

The statistical noise ^/N on the number of counts N — 
(S+b)t after a measuring time t will be dominated near Eq 
by the background and further below by the cubic term. 
The noise of the latter rises like {Eo — E)^ and hence faster 
than the mass dependent signal. In between there must be 
a point with optimal sensitivity on m^(zye); it is found at 



S = 2b. 



(7) 



From a measurement at that point for a time t one would 
calculate 00] a statistical uncertainty by the help of ISJ 



1/6 



(8) 



jdR/dEo) 
{dR/dm^{u^)) 



SEo = 2{Eo - E)dEo/c^ . (10) 




spectrometer 



S4 S5 ' 



detector 



We see that the dependence on the background rate is 
fortunately much weaker than that on the specific signal 
rate. For the characteristic parameters of our experiment 
Cr = 1.1 • lO-VeV^s, b = 0.015/s, one finds the optimal 
point at 14 eV below Eq and for the value of ^ 

Sm^{iy^)c^ ^ 920{t/s)-hY^. (9) 

Within 10 days measuring time © drops to 1 eV^. In an 
actual experiment one needs of course quite a number of 
measuring points within a reasonable interval in order to 
fix also the other parameters Cr, Eq, b and to check the 
spectral shape in general by a fit. 

At a particular measuring point E, an endpoint uncer- 
tainty SEq correlates to 5m{ve)^ according to (0 as 



Fig. 3. The improved Mainz MAC-E-Filter is shown schemat- 
ically. The distance between source and detector is about 6 m 
and the diameter of the spectrometer vessel is 1 m. From left to 
right: Frozen T2 source housed in the tilted solenoid SI; guid- 
ing solenoids S2, S3; the vessel with altogether 27 electrodes; 
refocussing solenoid S4, S5 housing the detector. The shown 
magnetic field lines confine the flux tube within which the /3 
particles are guided. 



Hence 5ni?{ve) increases in proportion to the distance 
from the endpoint, i.e. the neutrino energy E^. This is 
the crux of any missing mass experiment in relativistic 
kinematics where (I10|l follows quite generally from the 
quadratic mass energy relation m^c^ — E^ — p^c^ . That 
underlines again the necessity of measuring the neutrino 
mass close to the (3 endpoint and disfavours any other ex- 
perimental concept involving energetic neutrinos in order 
to gain phase space, i.e. rate. 

Instead of fitting Eq together with the other parame- 
ters from the data one could consider to use the known 
Q value instead PHI. Its error of 1.7 eV, however, would 
cause through (|10|l in the most sensitive region, i.e. around 
14 eV below the endpoint, an error in rn^ive) of about 
50 eV^/c^. This is far beyond our present value obtained 
from an inclusive fit. The latter is sensitive only to the eas- 
ily measured small voltage differences in the scan rather 
than to the absolute energy scale. 

On the other hand, we learn from (|10() that Eq should 
be fitted including somewhat larger distances from Eq, 
since its uncertainty 5Eq decorrelates from 5vn?(ve) hke 
1/{Eq — E). Altogether, there are in principle three spec- 
tral regions from which the basic parameters: b, m?{ve), Eq 
are fitted most sensitively and with a minimum of crosstalk: 

(i) a region beyond Eq fixing b, 

(ii) a region shortly below Eq fixing vn?{vc,) and 

(iii) a region further below Eq fixing Eq. 

In the latter region, however, the inelastic components of 
the spectrum and their uncertainties start to matter which 
finally dominate the systematic error. Hence we expect an 
optimal length of the measuring interval at which we meet 
a proper balance between the systematic und statistical 
uncertainty of the result. 



3 Improvements of the Mainz MAC-E-Filter 

/3-spectroscopy in the endpoint region by an electrostatic 
filter is particularly advantageous in combination with an 
electron optics based on the principle of magnetic adia- 
batic coUimation (MAC-E-Filter) {21u22) . Particles of charge 
q are transported from the source to the detector by spi- 
raling along the lines of a magnetic field B connecting 
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both (Fig. 131. Hence they can be accepted in the full for- 
ward solid angle of 2tt, in principle. An electrostatic filter 
potential U in between is passed if the longitudinal energy 
along the guiding i?-line is larger than qU. In order to 
filter the full energy sharply the particle momenta have 
to be well coUimated along B. This is achieved by low- 
ering the field strength from a very high value -Bmax to 
a quite small one i?a in the region of the analyzing po- 
tential. Thereby the transverse energy in the cyclotron 
motion E± is reduced adiabatically in proportion to the 
magnetic field strength and transformed into longitudinal 
energy along B. The non relativistic limit the trans- 
formation reads: 



B„ 



E 



J^max 



AC/ 

IT' 



(11) 



(HH) defines the relative width AU/U of a MAC-E-Filter. 
If the field maximum is placed at the source, -Bmax = ^s, 
then it accepts the full forward solid angle Af2 = 2ti. 

In reality we have limited the acceptance to a maxi- 
mum start angle ©max by placing a field maximum -Bmax > 
Bs in between source and analyzing plane acting as mag- 
netic mirror for particles starting at angles > ©max 
with 



0n 



i^bJK 



(12) 



Moreover, the angular distribution is slightly modified from 
isotropy by a scanning potential Us on the source. Still the 
transmission function is analytic j41| . For charges q—~e 
it is given in the 4 adjacent intervals 



(*) 
{^^) 
{Hi) 
(iv) 

by 



E-eUs< -eC/a 

-eC/a < E ~ eUs < -e ■ Smax/(Smax - ^a) 

— eUi^B-[na.^/{B-[na.^ — -Ba) < E ~ eUg < -E-Bmax/-Bs 

(E - eUs)/E > Bmax/Bs 



T = < 





1 - 

1 - 
1 



1 _ E-eU^+eU^ 
E 



1 - 



E-eU, B, 
E Sa 



(1) 

(h) 

(Hi) 

{iv). 



(13) 



The second line of ((T^ describes the sharp rise of the 
transmission from to a plateau within the filter width 
AUs = Af/. The third line describes a further, slow rise 
of the transmission in the plateau region as function of an 
accelerating, thus forward focussing scanning potential Us 
on the source until the mirror function of -Bmax is ruled out 
in {iv). Transmitted electrons are refocussed by solenoid 
S4 and hit a silicon detector in the centre of another 
solenoid S5 at a reduced field strength B^ — 0.31 • -Bmax- 
This limits the angle of incidence to 34°. By the help of 
auxiliary coils around the central part of the spectrometer. 



-Ba can be varied independently and hence the resolution 
through inillSl)- A ratio 



BjBs > As/ A, 



(14) 



has to be observed, however, in order to keep the cross sec- 
tion of the beam carrying flux in the analyzing plane well 
inside the cross section A^ of the cylindrical electrodes. 
As= 2 cm^ is the cross section of the T2 source. We have 
been running at field ratios down to B^/Bs — 3.3 • 10"'', 
which limits the flux tube diameter to 88 cm as compared 
to the diameter of 94 cm of the central electrode. 

These relations play a role for the background since 
the electrodes will emit secondary electrons when they are 
hit by cosmic rays or any other particles originating from 
radioactivity. If accelerated toward the detector these elec- 
trons will arrive with an energy close to that of the trans- 
mitted /3-particles and cannot be discriminated by the 
1.4 keV (FWHM) resolution of the detector. It is impor- 
tant, therefore, that these secondary electrons are being 
guided adiabatically along magnetic field lines which pass 
by the detector. Still we observe enhanced background on 
its outermost ringsegments. Moreover the central guiding 
field should not be lowered below -Ba « 5 • 10"'* T in order 
to guarantee full transmission of the 200 eV energy inter- 
val under study ^40_, . Another set of correction coils around 
the spectrometer annuls the transverse component of the 
earth's magnetic field and steers the (3 flux. Runs were per- 
formed at settings -Bmax = 2.211 T, -Ba = 5.67 • lO""* T, 

Bs = 1.087 T (0max = 44.5°) or Bs = 1.693 T (©max = 

61.6°), C/a = -18690 V, -20 V> Us >-320 V. More details 
on the general setup and function of the Mainz MAC-E- 
Filter have been given in |21II41| . and on its recent im- 
provements and performance in |42II43II44| . 



3.1 The new source section 

In the following we will focus on the various improvements 
of the apparatus, performed in the years 1995-97 _42_. A 
decisive improvement concerns the replacement of the LHe 
bath cryostat by a flow cryostat which allowed to cool 
down the T2-carrying substrate below 2 K by a horizon- 
tal cooling section, designed and built by Oxford Instru- 
ments on customer's demand. Below that temperature the 
shock condensed, amorphous T2-films have been proven 
to be stable in time. Earlier the source had been operated 
at temperatures between 3 K and 4 K, at which these 
films turned out to dewet from the substrate and to con- 
tract into small crystals with an average thickness much 
larger than that of the original film |45II46II47| . Within 
these crystals the chance for multiple inelastic scattering 
events of /3-particles is enhanced, shifting their energy loss 
spectrum towards higher losses. Undiscovered, this shift is 
faking a lower endpoint in the fit which in turn drives 
TO^(i'e)through the correlation H10|l into the unphysical 
negative sector. 

This effect is the stronger, the more the data interval 
extends towards lower energies where it takes in more of 
these multiple scattered particles. This trend was clearly 
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seen in our first publication, already, and attributed to 
a yet unidentified additional energy loss component at 75 
eV [25_ . Actually, this number makes sense to the multiple 
scattering explanation, since the average energy loss per 
scattering event is (34.4±3.0) eV 0H1 and double scat- 
tering prevails in these tiny crystals. Duly later, how- 
ever, we learned about the dewetting possibility of hy- 
drogen films which was not expected to occur below 
the triple point. We were thus forced to study this phe- 
nomenon also for tritium films, determined the decisive 
activation energy for surface migration to be 45 K and 
concluded from that on a dewetting time constant 3> 1 
year at T < 2 K 0^ . The substrate temperature through- 
out running was (1.86±0.01) K ^. Moreover, the source 
section was upgraded to house a larger (2 cm^ instead 
of 1 cm^) and thicker source (« 140 instead of 30 mono- 
layers of T2) in order to cope with the strong gaseous 
T2 source of the competing experiment at Troitsk 123'. 
As substrate we have used again highly oriented pyrolytic 
graphite (HOPG) which combines three advantages: 

(i) low backscattering due to the low Z, 

(ii) atomic flat surface over wide terraces, 

(iii) high purity '50^ 

The substrate was glued to the copperhead of the cryostat 
with the silverloaded, heat conducting glue H20E (sup- 
plied by Polytec, D-76337 Waldbrunn). It withstood cryo 
as well as baking temperatures of 410 K. 

Also the source preparation section has been modified: 
T2 gas was released from a heated titanium pellet and fed 
through a vacuum baked stainless steel capillary and by 
help of a mechanical UHV manipulator into a cold (20 K) 
radiation shielding tube which surrounded the substrate 
(Fig.0J. The precooled gas then entered a teflon cup with 
an inner cross section of 2 cm^ which was pressed against 
the substrate. A kind of diffusor at the inlet ensured a ho- 
mogenous molecular flow onto the substrate. The isotopic 
composition was checked by a quadrupole mass filter. The 
isotopic T content of the individual sources varied between 
63% and 84%. It was considerably improved as compared 
to phase I. 

Radiation shield and evaporation cup were provided 
with quartz windows passed by a He-Ne laser beam which 
monitored on line the growth of the source film by ellip- 
sometry. For a given polarization status of them incident 
beam, the status of the outgoing beam depends through 
Fresnel's formulas on the reflection from both sides of the 
film and on the interference of the partial waves. Hence 
the complex refractive indices (nf(s) -l-ifcf(s)) of the film (f) 
and the substrate (s) enter as well as the film thickness 
d and the angle of incidence 0. EUipsometry is performed 
by help of a polarizer and a A/4 compensator in the inci- 
dent beam and an analyzer in the outgoing beam ahead of 
a photocell (Fig.^. Fixing the easy axis of the compen- 
sator to 7 = 45° with respect to the plane of incidence one 
searches for that pair of polarizer angle (a) and analyzer 



Polarizer (a) 
nsat 



ccjmpensator \^,'" ' 

^\ He-Ne laser 



S '-^ Tel 



20 K shield 



Tj, Dj, ^^Kr'^supply 
Teflon tube 

^^yl^ photo sensor 
analyzer ^''^^^^^^ 



Fig. 4. Scheme of the tritium source with setup for growing 
the T2 film and controlling its thickness by ellipsometry 




This number corresponds to the reading at the cryostat 
itself, the absolut precision of the temperature is known to 
0.1 K. 



-10 -5 
P~Pstart 

Fig. 5. Control of film growth by ellipsometry for D2 (open 
circles) and T2 (full circles). On the axes are given the corre- 
sponding shifts of light extinguishing (a, /3)- pairs. The lines 
are fits to the data. The loop closes at the first interference 
order. 



angle (/3) for which the reflected beam is extinguished. 
They are functions of the above parameter set |51| . 

Except for fcf « the indices are not known a priori 
with sufficient accuracy. Hence we have grown stepwise 
rather thick films of D2 and lately also T2 up to the first 
interference order at (i=4200 A, determined (a, /?) pairs 
of extinction (Fig. and fitted the parameter set to the 
data with the results (for the example of Fig. O 031 ■ 
D2 film: nf(D2) = 1.148, = 2.75, = 1.34; T2 film 
((65±10)%T, (35±10)%H): nf (T2) = 1.156. is measured 
geometrically to be (59±0.3)°; the fit yields about equal 
value and precision for 0. 

The T2 films used in the runs are less than 500 A thick 
and the measured (a,/?) pairs cover only a small section 
of the full loop, indistinguishable there between D2 and 
T2. The only parameter safely extracted from this short 
section is the optical film thickness nfd. For our experi- 
ment, however, counts the number column density patc?, 
connected to the refractive index by the Clausius Masotti 
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relation 



with a = 0.81(1)A^ being the polarizability of hydro- 
gen molecules (for any isotope). From our ellipsometric 
rif values we thus determine a molar volume of shock- 
condensed D2: V[noiD2, shock = 21.32 cm'^ and of 
T2: KnoiTs.shock = 20.27 cm^ The respective lit- 

erature values for solid (closely packed) D2 and T2 are 
19.95 cm^ inSI and 18.9 cm^ [H| respectively. The latter 
is based on calculations. Hence our shock-condensed films 
exhibit a porosity of 

P = (1 - ) = 6.4% (D2) and 6.8% (T2). (16) 

^'^mol, shock 

This is considered in our later discussion on energy loss. 

Up to the year 2000, we have analysed the ellipsometry 
of T2 films using refractive index and molar volume of our 
shock condensed D2 films. This lead to a systematic un- 
derestimation of the T2 column density by 1%. Note, how- 
ever, that the isotopic composition of our T2 film varies 
up to 20% leaving still a slight residual uncertainty about 
the molar volume of the actual film IT. Moreover, we 
mention that an alternative calculation of the T2-column 
density from the measured count rate leads to qualitative 
agreement but is not sufficiently precise for a quantitative 
check. 

The optical quality of the graphite surface apparently 
deteriorated somewhat in time, and led to an increase of 
the relative error of the film thickness from ±3% (usual 
case) to -|-7%/-6% for the worst case of run Q8 (for more 
details see ,42 ,43,44). It is a major contribution to the 
systematic error through the resulting uncertainty in the 
energy loss within the source. 

After film preparation the source is pushed into the 
front end of a LHe-cooled chikane, which spans through- 
out the kinked solenoids SI und S2. It is the second impor- 
tant improvement of the source section. Evaporating T2 is 
adsorbed on its carbon coating and the straight fiight into 
the spectrometer is prevented by its 20° bent, whereas the 
magnetized charged particles follow the equally bent field 
lines. The cryotrap totally rejected any source dependent 
background which earlier made up half of the background 
rate, even for much thinner sources. 

The cryotrap also suppressed condensation of rest gas 
(predominantly II2) from the spectrometer onto the T2 
film. Still we have observed by an ellipsometric check at 
the end of a run a certain growth of the film thickness 
by 0.14 monolayer/day. The source activity, on the other 
hand, decayed with an apparent lifetime of about one year. 
Obviously the recoiling daughter molecules each sputtered 
a handful of neighbouring molecules off the source. 



3.2 Electrode and HV system 

The design of our spectrometer has been aiming at a short, 
economic instrument with high resolution, that is a high 



field ratio -Bmax/-Ba. Consequently it has sharp B gradi- 
ents which endanger adiabatic motion. Therefore, we have 
tried to compensate this drawback by decelerating and 
reaccelerating the particles partly in the high field within 
the solenoids S3 and S4. This was provided by a series of 
ring electrodes. 

However, field emission by the strong electric field and 
particle storage by the strong magnetic field, together 
favour the development of plasmas even under UHV con- 
ditions. Such plasmas lead to an untolerable background 
rate at field settings Bmax > 2 T. Hence the spectrometer 
could not be operated up to its limit of JSmax = 8.6 T 
where adiabaticity would be observed best |21|. 

Therefore, the improvement phase also included a re- 
design of electrodes No. E6 to Ell in the high B field 021 ■ 
Their number was increased by 2 (E12,E13) in order to 
smoothen the potential drops and titanium was chosen in- 
stead of copper for reasons of lower field- and X-ray emis- 
sion. The latter was suspected to produce through sec- 
ondary reactions a background component observed about 
5 keV above the filter potential whose tail still extends 
into the accepted energy window of the detector pHllKHl 
1^ . Moreover, these electrodes were reshaped such that 
they include about the same magnetic fiux (« 6 Tcm^) 
everywhere. The new electrode system performed better 
in so far, as the mentioned background component disap- 
peared, indeed, and a breakdown voltage of -30 keV could 
be reached safely within a shorter conditioning phase. 

But still the plasma induced background rate rose be- 
yond -Bmax ~ 2 T. In the presently running phase HI of 
the experiment, which comprises an extensive background 
exploration and reduction program to prepare the follow- 
up experiment KATRIN 57_, we have removed the multi- 
electrode system from the high field region and retained 
only a few central electrodes, all set to the full analyzing 
potential. Now the spectrometer is stable up to the high- 
est B field, in accordance with earlier experience at the 
Troitsk spectrometer. For this latter, non-bakable instru- 
ment no stable running mode was found at all with the 
original multielectrode system |58j . 

The filter potential ?7a was provided by a highly stabi- 
lized HV power supply (model HNC5 30000-5 by Knuerr 
Heinzinger, D-83026 Rosenheim) directly connected to the 
central electrode. The potentials of the other electrodes 
(requiring less precision) were derived from by a home- 
made resistive voltage divider, t/a was monitored and read 
out continuously by two different systems: The first system 
comprises a high-precision digital voltmeter (model DMM 
6048 by PREMA, D-55129 Mainz) which was connected 
to C/a via a precision voltage divider 1:5000 (model KV 50 
by Julie Research, New York, USA). In the second system 
the voltage C/a was divided by 1:50 by a second voltage di- 
vider (model KV 50 by Julie Research, New York, USA) 
and the difference to a voltage standard (model 335A 
by Fluke) was measured by a precision digital voltmeter 
(model DMM 5040 by PREMA, D-55129 Mainz). The ob- 
served short- and long-time fiuctuations comply with the 
specifications of the instruments. To check the HV equip- 
ment the K(32) conversion line of ssmj^,. ^^g^ measured 
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before or after each tritium run. The values show a small 
drift from Q2 to Q12 but the difference to the fit values 
for Uq (given in Table 1) of 1998-2001 can be summer- 
ized as 749.5 ± 0.5 eV and appear reasonable compared 
to the specification of the HV chan. To control the sta- 
bility during a measurement periode, we analysed shorter 
time intervals and compared the resulting retarding volt- 
ages which are found by the fit for the endpoint values. 
They agree within their statistical uncertainties. 

The scanning potential in the range -320 V< Us <- 
20 V was provided by a fast computer controlled power 
supply model HNCIG 3500-10 by Knuerr Heinzinger, D- 
83026 Rosenheim) and applied to the electrically insulated 
source. A high-precision divider (Fluke) and a high pre- 
cision digital voltmeter (model DMM 5017 by Prema, D- 
55129 Mainz). The minimum negative bias of -20 V pre- 
vents, that recoil ions emmitted from the source are ac- 
celerated into the spectrometer where they cause a high 
background rate through rest gas ionization [23] . 

3.3 Spectrometer vacuum and conditioning 

The improvement program also comprised electropolish- 
ing of the spectrometer tank and its electrodes, in order to 
reduce outgassing and field emission but also for remov- 
ing any tritium contamination from phase I when we were 
running without the protection by the cryotrap. Also the 
80 m of getter strip (type ST 707/CTAM/30D by SAES, 
Milano, Italy), mounted onto the inner surface of elec- 
trode E2 were renewed. It represents a pumping speed of 
18 m^/s for hydrogen. The spectrometer was pumped in 
addition by 2 turbomolecular pumps at 500 1/s each. 

Once a year the spectrometer was baked for about a 
week reaching a maximum temperature of 330° C to 420° C 
for about 24 hours, at which also the getter was activated. 
Thereafter the rest gas pressure (mainly II2) reached a 
level of better than 10^^° mbar. Although we could not 
observe any deterioration of the vacuum in between, the 
performance of the spectrometer apparently improved af- 
ter a very intense rebaking in 2001 in the sense that tiny 
anomalies appearing in the spectra of runs Q9 and QIO in 
2000, did not occur anymore, thereafter. 

In addition to electropolishing and baking, condition- 
ing of the spectrometer up to ±30 kV, well above the oper- 
ating voltage of 18690 V (neg.), proved to be necessary to 
prevent any spar kings or minisparkings during runs. The 
latter are not observed in the electric circuit but manifest 
themselves by an outburst of background events which die 
out quite slowly such that a whole scan (passing all mea- 
surement points twice) has to be rejected. In the runs of 
2001 (Q11,Q12), not a single background burst has been 
observed. In all earlier runs they appeared about once a 
week. 



3.4 /3-detection and data acquisition 

Transmitted /3-particles are detected by a silicon detec- 
tor which is segmented into 5 circular rings of 1 cm^ area 



" 4000 
2000 





12 14 16 18 20 22 

electron energy [keV] 

Fig. 6. Detector response to the last 200 eV of tritium /3 de- 
cay. The perpendicular lines indicate the accepted window (15- 
21 keV). 



each. Usually only the three inner segments are consid- 
ered for data evaluation, the fourth displays already en- 
hanced background which increases towards the spectrom- 
eter walls. The radial segmentation is also useful for ac- 
counting for the potential drop which occurs in the centre 
of the analyzing plane and achieves 4-10~^ Un on axis. 

For phase II the possibly contaminated old detector 
was replaced by a new one with a still thinner dead layer 
but otherwise identical specifications (B1256 by Eurisys 
Mesures, France). The energy loss in the dead layer was 
determined to be about 200 eV at E=18 keV, correspond- 
ing to a mass layer of about 15 /xg/cm^. The detector to- 
gether with the attached preamplifiers were cooled down 
to « — 80°C. The preamplified signals were fed out of the 
vacuum for further amplification and pulse height analy- 
sis. Details are given in j59ll60j . 

Backscattered electrons are remirrored onto the detec- 
tor within its intrinsic time resolution. They contribute to 
the low energy tail of the signal with an energy loss by 
multiple passage through the dead layer. Fig.^lshows the 
detector response to the last 200 eV of the tritium (3 spec- 
trum. The FWHM is 1.4 keV, the accepted energy window 
15 keV to 21 keV. Reinforcement of low level lead shield- 
ing and removal of some potassium containing material 
reduced the background from environmental radiation by 
a factor of 3 down to a rate of 4.6T0~^/(s keV) on each 
segment. Moreover, the vacuum conditions of the detec- 
tor housing were improved to UHV standards in order to 
allow removal of the thin foil which earlier had separated 
it from the much better spectrometer vacuum. It had de- 
teriorated the energy distribution of the passing /3's |21| . 
Instead an open, getter coated tube was installed serving 
as an active differential pumping section 42 . 

At fixed energy window of the detector its efficiency 
slightly increases with P energy due to the asymmetric 
signal slope. By offsetting the P spectrum at the source 
the respective coefficient was determined to be ad = (4 ± 
2)%/keV . It is considered in the analysis withn marginal 
effect. The low count rate of less than 250 Hz allows to 
acquire the data event by event without suffering substan- 
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Fig. 7. Distribution of the 45 measurement points in runs Qll 
and Q12. In the dense region their spacing is 1 eV. 



tial losses by signal processing and read out, requiring al- 
together 63 /iS . Pile up rejection rises no problem in 
view of the time constant of 3 /us of the analogue circuit. 
Since any enhanced pile up rate points to electronic noise 
or some other pertubation it is recorded in order to reject 
such periods in the off line analysis. The event protocol 
comprises height and real time of the event. Moreover, its 
time difference to the foregoing event is recorded with a 
resolution of 100 fis for the purpose of correlation studies. 
Scanning of the spectrum via the source potential Us is 
PC controlled. Usually a measuring time of 20 s per data 
point was chosen. Their distribution has been adjusted to 
ensure a properly weighted sensitivity to the decisive fit- 
ting parameters. Fig.Hshows the example of runs Qll and 
Q12. Other runs had somewhat different distribution and 
number of measuring points. The potential differences be- 
tween data points are ramped with soft slopes over 3 s in 
order to prevent particle trapping by sharply rising poten- 
tial walls. A total scan comprises an up and a down scan. 
At the end of each data point the filter and source poten- 
tials Ua, Us are read out and stored. Moreover a number 
of other important control parameters such as the source 
temperature, the He throughput through the cryostats, 
the status of the vacuum system etc. are monitored. 

Any considerable deviation from normal status acti- 
vates an automatic control and safety system which com- 
municates the malfunction as short message via mobile 
phone to the operators in charge. It also performs a safety 
shutdown if necessary. Vice versa the operators could ac- 
cess the control system at any time and read out the essen- 
tial parameters remotely. Except for serving hours, there- 
fore, the experiment was running around the clock in a 
stand alone mode, a necessity in view of the small crew 
involved. 



4 Measurements in phase II, 1997-2001 
4.1 Spectrometer background 

Fig.lHlshows a typical background spectrum from the spec- 
trometer as measured by the detector with the T2 source 
closed off, either mechanically by a valve in the beam line 
or just with respect to the /? particles by a filter poten- 
tial above Eg. The installation of the bent cryotrap has 
totally suppressed any source dependent background as 
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^ From 2000 on this number was decreased to 50 /is due to 
a faster computer for data aquisition. 



Fig. 8. Spectrometer background spectrum, collected for 13 h 
on detector segment 3. The perpendicular lines indicate the 
accepted energy window for evaluation. 



said before. On top of a smooth continuum one observes 
a single peak. A high statistics analysis has shown that 
its mean coincides with the filter potential within an un- 
certainty of about 30 eV. Most probably this peak is a 
sharp line, actually, stemming from electrons, produced 
at low energy somewhere in the large analyzing volume 
of the spectrometer or at the surface of the respective 
electrodes, and then accelerated by the filter potential to- 
wards the detector or the source. According to (11) this 
is possible, if their transverse energy i?_La is less than the 
filter width of about 4 eV. Otherwise they will be trapped 
magnetically within the B field minimum in the centre. 

The rate of this background, which we cannot distin- 
guish from the /? particles, ranges from about 12 mHz in 
the very best cases of the last runs Qll and Q12 up to 
the order of 50 mHz at poorer performance. The numbers 
from the similar Troitsk experiment are quite comparable. 

The phenomenology of our spectrometer background 
has been studied extensively in a number of thesises over 
the years 21,56,61,62,63,64,65,66 . The qualitative in- 
sight obtained thereby was very instrumental for improv- 
ing to the present satisfactory status. But the various 
mechanisms at work are complex, apparently, such that 
they could not be identified and disentangled clearly and 
pinned down quantitatively, neither by experiment nor 
by simulation. Only the radical hardware measures dur- 
ing the presently running, background dedicated phase 
HI are giving experimental access to a somewhat bet- 
ter understanding of the underlying mechanisms |63II64I 
ESBHS]. Thus routes for further background suppression 
are opened for KATRIN. Since this will be subject of a 
forthcoming paper (BTj . we will confine the background 
discussion in this paper to the context of phase II runs 
and results. 

From background studies with external 7 and X-ray 
sources and from coincidence with passing cosmic muons, 
it seems to be clear that an important background com- 
ponent - if not all of the observed "hard core" of 12 mHz 
- consists of secondary electrons emitted from the inner 
surface of the large central electrodes. In perfect adiabatic 
motion they would spiral along peripheral flux lines which 
pass by the detector. However, the actual electromagnetic 
configuration with its rather weak central B field in com- 
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Fig. 9. Histograms of background rates during the measure- 
ments Q5 and Qll. Each entry is an average over 8 scans, 
where the measurement time in the background region adds 
up to 600 s for each scan. 



bination with radial E field inhomogenities seems to give 
them a chance to drift into the sensitive flux tube on a 
non adiabatic path. From muon coincidences we learned 
that at least part of them arrive within a few /is. At UHV 
conditions, these events cannot be affected any more by 
rest gas collisions. Recently we have found that such elec- 
trons can be rejected by a grid at some repelling potential 

Contrary, a single high energy electron, as e. g. from T2 
decay within the sensitive flux tube of the spectrometer, 
may well be stored magnetically for minutes and cause 
background events by rest gas ionisation with an average 
rate of the order of the observed one at a vacuum of 10"^" 
mbar. At 10 times higher pressure this background source 
can be recognized (and also eliminated at low signal rate) 
as a relatively fast chain of correlated events 23 . Also 
minisparks or field emission may end up eventually in such 
trapped high energy electrons. 

Guided by such hypotheses we have applied rf pulses 
of (1.0-1.8) MHz and up to 180 V amplitude onto par- 
ticular electrodes in order to heat up such trapped elec- 
trons stochastically and expel them |27II61| . This attempt 
turned out successful, in fact, when the rf pulse was ap- 
plied to electrode E8 on the detectorside which is at a 
DC potential of 0.86 Ua,. The rf was applied for (1-2) s 
each time, during the pause when the scanning voltage 
was changed. In run Q5 for example we thus managed to 
reduce the background rate from an unsatisfactory level 
of 50 mHz down to «20 mHz j^. 

Fig. ini shows two histograms of background fluctua- 
tions, the one from run Q5 with pulsing, the other from 
run Qll without pulsing. In the former case pulsing did 
reduce an enhanced background to an acceptable average 
rate of b — 21.6 mHz. But the fluctuation is apparently 
wider than Vbi, expected from ordinary statistics. This 
makes sense, since enhanced background rates during the 
occasional presence of ionizing trapped electrons obey a 
kind of Levi statistics with irregular fluctuations. On the 
other hand, the low and steady "hard core" background of 
b = 12.6 mHz, achieved in Qll, displays a nearly ordinary 
fluctuation. 

At UHV conditions, also the build-up and decay of 
trapped plasmas will occur on longer time scales A 
certain phase space of electrons can be trapped everywhere 
within the sensitive flux tube of the spectrometer, either 
by magnetic mirroring at both necks of the magnetic bot- 



tle or only at one of them and electrostatic reflection at 
the central filter potential. 

Outside the sensitive flux the stepwise increase of the 
diameter of electrodes forms small equipotential corners 
crossed twice by magnetic field lines. This is the elec- 
tromagnetic configuration of Penning traps. Electrons re- 
leased from plasmas in such traps may eventually find 
their way to the detector. Also ions from such plasmas, 
positive as well as negative ones, can contribute to the 
backgroud by secondary reactions as said before. 

If trapped plasmas are fed at least partly by /3 parti- 
cles from the source, then the background they produce 
will depend on the /3-flux therein, which varies with the 
scanning potential of the source. Such kind of cross talk 
between scanning and background could be the origin of 
the tiny residual spectral anomalies which have been ob- 
served in few of the runs and reported already in \27\ . 
Their amplitude is on the level of mHz, i.e. of order 10% 
of the total background rate. The slow build-up and decay 
rates of stored particles may also give rise to the hysteresis 
of these anomalies which has been observed between up 
and down scanning in run Q9. 

In a pulsed mode of running, the technique of which 
has been described in [SHI, we have searched for a back- 
ground dependence on the scanning voltage in a time win- 
dow ranging from a few fis to 30 min after shutting off the 
signal rate by a positive pulse on the source. Within sta- 
tistical limits of 1 mHz we did not observe any correlation 
between the background rate in the pauses and the signal 
rates in the open phases of the spectrometer jHU . This neg- 
ative result does not really contradict our presumptions on 
the possible origin of the residual spectral anomalies, since 
these have only rarely occured at non optimal conditions. 

Total stability of the background rate over the full run- 
ning period has been observed for runs Qll and Q12. 



4.2 Discussion of Runs Ql to Q12 

In Table 1 we have listed characteristic parameters of all 
12 runs Ql to Q12 performed with the improved setup in 
the period 1997 to 2001. They covered an interval from 
18370 V up to 18860 V, i.e. from 200 eV below to 90 eV 
above Eq (Fig.[7|). 

We should mention that we fitted the parameter rn^ive) 
as really free parameter without constraints. In order to 
account for statistical fluctuations of the data the fitting 
routine^ requires a mathematical continuation of the spec- 
trum into the region m^ive) < which provides a symmet- 
ric parabola around vi^ive) — for a statistical data 
sample. This purpose is fulfilled quite well by introducing 



* The shape of the /3 spectrum near the endpoint is mainly 
defined by the factor (_Eo — E) {Q — E)^ — m?{v^)c^ which 
can be expanded for {Q — E) ^ ■m{ve)(? into (-Eo — E)"^ — 
m^(i/e)/2. Therefore for a neutrino mass around zero any fluc- 
tuation of the count rate downwards yields a positive value 
for m^{ve) and vs. any fluctuation upwards should result in a 
negative value of the parameter mF'ii'e). 
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Table 1. Parameters for measurements Q1-Q12 of phase II. 
©max = maximal opening angle, t = running time, pt = num- 
ber of different measurement points, ft = film thickness, b = 
average background rate, m^(i/e) — fit result for the last 70 eV 
and Uo ~ retarding voltage at which fit finds endpoint value. 



no. 




t 

[d] 


pt 


ft 
[nm] 


b [mHz] 


[eV^] 


Uo [V] 


Ql 


45° 


6 




20.8 




test measurement 


Q2 


45° 


26 


50 


96.7 


16.7±0.3 


-11.2±6.0 


18573.5± 0.3 


Q3 


45° 


24 


64 


49.3 


12.7±0.2 


-14.8±4.6 


18574.0 ± 0.2 


Q4 


45° 


38 


64 


49.5 


11.7±0.2 


-3.9±4.7 


18574.5 ± 0.2 


Q5 


45° 


46 


64 


47.5 


21.6±0.2 


-3.5±6.0 


18574.4 ± 0.2 


Q6 


62° 


38 


33 


43.0 


12.5±0.2 


+0.4±7.2 


18575.7 ± 0.2 


Q7 


62° 


29 


33 


43.2 


14.3±0.2 


-2.4±4.9 


18575.4 ± 0.2 


Q8 


62° 


54 


39 


45.5 


16.5±0.2 


-0.9±4.8 


18576.2 ± 0.3 


Q9 


62° 


56 


39 


44.4 


18.6±0.3 


-10.9±3.2 


18575.1 ± 0.2 


QIO 


62° 


35 


45 


45.5 


16.6±0.3 


-6.1±4.8 


18574.6 ± 0.2 


Qll 


45° 


31 


45 


48.2 


12.6±0.2 


+1.3±5.8 


18576.7 ± 0.2 


Q12 


62° 


19 


45 


48.5 


12.6±0.2 


-1.0±6.0 


18576.6 ± 0.2 



factors fi to each electronic final state in (0) defined by 



(17) 



with Ci = Eq — Vi — E, fi = —0.66 m^(z^e)c'' _ 2 5 . For neg- 
ative rn?{ve) they stretch the spectrum smoothly beyond 
the respective endpoint up to Eq ~ Vi + fi. The negative 
im?{ve) sector might also be fitted by a physical model, 
namely the [3 spectrum arising from tachyonic neutrinos 
|60| . But this point would come up only in case of an un- 
ambigous experimental negative w?{ve) result. Summa- 
ryzing, negative values for the fit parameter rn?{ve) are 
not necessarily unphysical but should obtained within sta- 
tistical limits as result of an unconstraint fit in 50% of all 
data sets if the neutrino mass is around zero. 

In the following we will report on each of the 12 runs 
performed in phase II irrespective of wether it has been 
selected for the final data set. Thus we take the chance to 
discuss on the given example carefully experimental effects 
which might lead to spectral anomalies and systematic 
uncertainties if undiscovered. 

Ql and Q2: The first run Ql was devoted to a short 
test experiment with a relatively weak T2 source. We ob- 
served in particular that the background due to T2 evapo- 
ration into the spectrometer and decay therein had disap- 
peared as said above. Encouraged by this success we have 
produced a very thick source Q2 of 967 A corresponding 
to 284 monolayers. At this thickness the rate of (3 particles 
which leave the source without energy loss is already close 
to its maximum possible value obtained from an infinitely 
thick source. Running this high source activity turned out 
to be smooth and stable without any source dependent 
background problems. 

However, the analysis of the data revealed an average 
shift of the endpoint by -3 eV. This effect was then system- 
atically investigated by freezing ssmj^j. activity on top of 
T2 films and measuring precisely the energy of its 17.8 keV 



conversion line as function of the film thickness. This way 
we have discovered that the film charges up positively by 
21.2 mV per monolayer. The corresponding electric field 
strength of 62.6 MV/m is necessary to release the positive 
charges, left over from (3 decay, from their trapping po- 
tential within the T2 lattice. These first experiences with 
the improved set up have been communicated in 70 . A 
thorough analysis of source charging is given in 71 . The 
linear increase of the charge up voltage throughout the 
film has to be folded into the transmission function and 
results in a broadening in addition to an average shift. A 
systematic uncertainty in the broadening effect of Gaus- 
sian shape with variance would yield an uncertainty 
in m^(i/e) by — 2 • tr^ [72] • Therefore, we have reduced the 
film thickness by a factor of 2 in later runs. Moreover the 
uncertainty of the energy loss weighs heavier in a thick 
source than in thinner ones. Still, as compared to phase 
I results, the analysis of Q2 led to a reduction of the un- 
physical negative m^(i/e) value by an order of magnitude 
(see Fig.^lin sec. 5). 

Q3 and Q4: One might have expected that the resid- 
ual small negative m^(z^e) of order -10 eV^/c'' still ob- 
served in run Q2 would disappear with thinner sources. 
However, the following runs Q3 and Q4 showed the same 
problem at similar size but with somewhat different de- 
pendence from the fit interval. Moreover, the clearly en- 
hanced values obtained in fitting Q2, Q3 and in par- 
ticular Q4 pointed to some residual spectral anomalies in 
the data (see Fig. I13() . The Troitsk group had already re- 
ported on a step like anomaly which appeared in their 
integral spectra with an amplitude of order 10~^° of the 
total decay rate and at variable positions in the range 
from 5 to 15 eV below the endpoint. The change in time 
of the positions of these steps seemed to be compatible 
with a half year period, even j2Hl- If attributed to a gen- 
eral physics phenomenon, e.g. a monochromatic line in the 
/9-spectrum of T2, it should appear in our spectra equally. 
Fitting such a step into the Q4 spectrum led to a signif- 
icant reduction of x^, and lifted m?'{ve) to an acceptable 
value of (-1.8±5.1stat±2.0sys) eV/c^, indeed gT]. Also the 
position at 13 eV below Eq and the amplitude of the step 
of about 6 mHz accorded to the Troitsk picture. In the 
following runs it was an important issue, therefore, to in- 
vestigate further and - if possible - eliminate these residual 
spectral anomalies. 

Q5 to Q8: Ahead of run Q5 we found out that an en- 
hanced and fiuctuating background rate could be reduced 
essentially by applying an rf pulse to electrode E8 on the 
detector side as has been reported above. In particular 
Q5 profited from this procedure; it reduced the averaged 
background rate from 50 mHz down to 21.6 mHz. Q5 was 
also the first run whose analysis did not reveal any spectral 
anomaly any more but yielded an m?{iye) value compatible 
with zero at good for any data interval (see Figll3|l. 

Still the background rate was higher in Q5 than in the 
foregoing runs which suffered from slight residual anoma- 
lies. Apparently these anomalies do not correlate neces- 
sarily to a higher average background; but a correlation 
between background events and the operating cycle of the 
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spectrometer - which clearly produces an anomaly - can 
occur also at low average background. At that point we 
recall that the anomalous count rate does not exceed a 
few mHz and hence constitutes at most a small fraction of 
the background rate. On the other hand the facts seem to 
corroborate the assumption that the removal of trapped 
electrons by pulsing also may brake the correlation be- 
tween background and operating cycle. Run Q5 was the 
basis of our result m^(i^e) — (— 3.7±5.3stat±2.1sys) eV^/c'^ 
with the limit m(z/e) < 2.8 eV/c^ (95% C.L.) pubhshed in 
1999 But also the series of data collected in the runs 
Q3 to Q5 could be analyzed successfully in a so-called 
"15 eV analysis". Besides the background region above 
Eq, only the last 15 eV of the spectrum were considered 
here together with two more data points further down at 
18470 eV and 18500 eV respectively; they were necessary 
to fix Eq with sufficient precision. Thus the " troublesome" 
region of anomalies was excluded mostly from the fit. The 
result was m^lve) = (— 0.1±3.8stat±l-8sys) eV^/C*, which 
leads to an upper limit of ■m{ve) < 2.9 eV/c^ (95% C.L.) 

m 

In between runs Q5 and Q6 the spectrometer was baked 
again to a maximum temperature of 394° C and HV con- 
ditioned. The procedure resulted in a background reduc- 
tion down to 12.5 mHz observed in Q6. This rate was 
independent of pulsing as proved by the no pulsing mode 
which ran alternatively every second day. Q7 was run- 
ning in the same alternating manner. Without pulsing the 
background had now increased to 14.7 mHz (the number 
given in Table 1), whereas it remained essentially stable 
at 12.7 mHz in the pulsing mode. Permanent pulsing was 
applied to run Q8, the background had increased further 
to 16.5 mHz. Note that these numbers are averages over 
the full running period. Without pulsing the background 
was slowly rising in real time and had to be set back by 
reconditioning the electrode system a few times during a 
run. 

On the thirty- first day of run Q8 the "apparent" life- 
time of the source (as measured from the course of its 
activity) increased from 300 to 620 days. The event was 
caused by a sudden coverage of the source with a couple 
of monolayers of H2 , which had been collected before from 
the residual rest gas onto the shield in front of the source. 
From there it was released then during a short cooling fail- 
ure of the shield and partly recollected onto the still cold 
source. The data from the remaining period yielded a sig- 
nificant negative 'm?{ve) value, caused by the additional 
energy loss in the H2 cover. Also under regular conditions 
the shield could not completely prevent a slow and steady 
condensation of residual H2 onto the source. A daily cov- 
erage by 0.3 monolayers was estimated from ellipsometry 
(see above) and considered in the analysis causing a small, 
still significant effect (see below). 

The analysis of the data set Q6 to Q8 yielded stable 
fit results of m^(i'e) close to zero at any data interval and 
with good (see Fig.lK^. Together with Q5 it improved 
the result, to: 
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Fig. 10. Hysteresis effect in run Q9 during periods with- 
out background suppression by pulsing. Squares correspond 
to scanning towards the endpoint, crosses to the opposite di- 
rection. 



from which an upper limit of m{ve) < 2.2 eV/c^ (95% C.L.) 
was extracted. This result has been communicated at the 
Neutrino 2000 conference and cited thereafter fre- 
quently. 

Q9 to QIO: The long period of data collection in runs 
Q5 to Q8 was followed by a number of systematic back- 
ground studies 61. 62 the results of which have been sum- 
marized above, already. Thereafter tritium measurements 
were immediately resumed in fall 2000 without a break 
for extended maintenance. Since the last baking of the 
spectrometer, which apparently had not reached the tem- 
perature of earlier ones, 6 months had elapsed. Although 
running was quite smooth at a moderate background rate 
of 20 mHz, the on line analysis of Q9 data showed rather 
soon a reappearance of slightly negative m?{ve) values 
around -10 eV^/c'*. Nevertheless we continued measuring 
since parallel runs were foreseen at Troitsk in order to 
check, whether any Troitsk anomaly would appear syn- 
chronously in both experiments. We also refrained from 
any interference by reconditioning the electrodes like in 
earlier runs. Rather we decided to watch how the running 
conditions and results would develop in time in the two 
alternating modes of cleaning and not cleaning the spec- 
trometer from stored particles by rf pulses. 

An apparent anomaly of Q9 is a hysteresis of countrate 
between up and down scanning: It is visible in the raw 
spectra already (Fig. I10() . Analysis shows that the effect 
was much stronger in the non-pulsed than in the pulsed 
mode. The effect also diminished when the final approach 
to each measuring point was performed always from the 
same side, namely from a higher voltage level; that means, 
upramping was performed by first overshooting the proper 
value and then pulling back as if it were downramping. 
The hysteresis clearly indicates the presence and infiuence 
of stored particles, whose accumulation and/or loss con- 
ditions correlate by some mechanism to the setting of the 
spectrometer. The instability of background conditions in- 
troduced this way is also witnessed by an enhanced scatter 
in Q9 as discussed above and shown in Fig. for the ex- 
ample of Q5. Even if the exact mechanism has not been 
cleared up yet in detail, the knowledge of its phenomenol- 
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ogy is already very important for the experimentalist and 
enables to prepare cautious countermeasures. 

In the following run QIO the measuring points have 
not been addressed in a monotonous voltage sequence but 
in a random generated one. Unfortunately, the software 
did not allow for a fresh random choice each scan with- 
out major changes. But the same sequence was repeated 
forth and back for the whole run. Still this was sufficient 
to suppress the conspicious hysteresis of Q9, not so the oc- 
currence of trapped particles as such, however. Hence also 
the QIO spectrum is slightly impaired by the imperfect 
running conditions, leading to a negative rn^iye) result in 
summary (see Table 1). Q9 and QIO data have also been 
analyzed in weekly time bins. They show fluctuations of 
the w?{viJ) fit result which exceed statistical limits. Hence 
Q9 and QIO data were not considered in the final fit. 

In spite of being slightly impaired, the Q9 and QIO 
spectra did not display any indication of a step like Troitsk 
anomaly, neither in the full data sets, nor in binned ones. 
This holds in particular for the time bins 6.12.-13.12. and 
22.12.-28.12.2000 where the Troitsk experiment was run- 
ning in parallel to ours. In both periods Troitsk, however, 
observed the sudden outburst of significant steps. In the 
second period it even reached an amplitude of 14 mHz 
(discussed further below). 

Qll and Q12: The experience of Q9 and QIO has re- 
taught us the importance of optimal maintenance ahead 
of running, although the vacuum had been fine all the 
time. Changes in surface conditions seem to rule field emis- 
sion of electrons and/or ions which fill residual traps and 
interfere with the measurement. Hence the spectrometer 
was rebaked at maximum temperature of 373°C for 13 h. 
Thereafter, the electrodes were conditioned up to ±30 keV 
with reinforced sparking at a residual hydrogen pressure 
of 10~^ mbar, obtained by heating up the SAES getters 
at closed turbo pumps. Also the source section was thor- 
oughly maintained including exchange of source substrate 
and T2-pellet, baking, etc. 

The efforts were rewarded with two absolutely clean 
and quiet runs Qll and Q12. From altogether 1620 scans 
1580 passed all control criteria in the analysis; among the 
few rejected runs prevailed incomplete ones due to some 
peripheral technical problem or intervention. The back- 
ground rate was stable and further reduced by 20% to 
12 mHz without the necessity of pulsing off stored par- 
ticles. In Qll we applied again a random sequence like 
in QIO, but returned to monotonous scanning in Q12. In 
the last week of Q12 we ran in a slow scanning mode at 
900 s per point instead of the usual 20 s interval. This way 
we searched for possible correlations of rates to scanning 
steps on an extended time scale but could not identify any. 

5 Analysis of data 

The way we analyze our data has been described before al- 
ready [25",'27""29 and will be shortly resumed. In the mean- 
time, we have developed certain refinements, which we 
also like to apply to the already published data resulting 
in slight changes of the results. 



5.1 Raw data selection 

The raw data of a run consist of a large number of single 
event protocols (see above), grouped into single measure- 
ments of 20 s at particular voltage settings. By help of 
the CERN routine PAW the raw data could be visual- 
ized in plots performing cuts of data and correlations of 
parameters. Outbursts of countrate, e.g. caused by some 
sparking, were identified and rejected manually this way. 
In fact the total scan was rejected in case of these rare 
events since they were followed by a longer " afterglow" of 
background events. In the latest runs they did not occur 
at all. Also other obvious malfunctions were identified and 
rejected this way. This first visual data screening was fol- 
lowed by an automatic one which identified for each single 
measurement significant deviations of the voltage readings 
from their nominal value or their average. If they exceeded 
0.1 V, the measurement was rejected. This made sure that 
even at the highest signal rate deep in the spectrum the 
corresponding signal deviation is less than 0.3(T. Moreover 
the program rejected single measurements when they con- 
tained more than 10 pile up events. For the remaining data 
it performed an automatic dead time correction reaching 
a level of 1% for the highest count rates. Altogether, the 
percentage of rejected data ranged from 2% to 6% for in- 
dividual runs. 



5.2 The fit function and the response function 

The data from runs Q2 to Q12 were fitted each by a fit 
function F(U), which is a convolution of the primary spec- 
trum (2) with the response function T'{E,U) of the ap- 
paratus plus a constant background b: 

F{U)= j {R{E)T'{E,U)AE)+b = R®T' + h. (19) 

T'{E, U) is again a fivefold convolution of the transmis- 
sion function H13() . the energy loss function in the film /loss, 
the charge up potential in the film /charge, the backscat- 
tering function from the substrate /back, and the energy 
dependence of the detector efficiency /dct ■ 

T'{E, U)^T® /loss ® /charge ® /back ® /det- (20) 

It is plotted in Fig. ^] for an electron starting some- 
where in the source with energy E and analyzed at a filter 
setting U=Ua—Us- Its structure is dominated by T^fioss- 
The filter opens for the elastic component when the retard- 
ing potential —eU balances the particle energy, reaching 
a first plateau 8 eV below. At that point the elastic com- 
ponent is fully transmitted. The slope of T' is stretched 
with respect to that of T by /charge which spreads over 
2.8 eV for a 140 monolayer source. The second, smaller 
and softer uprise results from integrating up the inelastic 
spectrum /loss- At a setting of —e-{U + E) = —50 eV 
electrons are transmitted to the detector with a chance 
of 98% already, /loss has been determined in parallel for 
gaseous hydrogen as well as for shock condensed films (ac- 
tually D2) with the (3 electron spectrometers at Troitsk 
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Fig. 11. Convoluted and normalized response function of the 
apparatus to electrons emitted at energy E and analysed at 
the filter vohage U. The filter width AU is set to 4.8 V, the 
maximum starting angle to ©max = 45° and the convolution is 
calculated for a source thickness of 490 A. 
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Fig. 12. Differential inelastic cross sections for 18.5 keV 
electrons scattered from gaseous hydrogen (dashed line) and 
quench condesend D2 (solid line) 148) . 

and Mainz, respectively US'. For the condensed case, the 
differential cross section da/dE was approximated by two 
model functions, a Gaussian peak at an energy loss of 
14.1 eV followed by a third order hyperbola (Fig. I12|) . 
The total inelastic cross section was found in this case to 
be tJtot = (2.98 ± 0.16) • 10~^* cm^ with a mean energy 
loss of (34. 4± 3.0) eV. As compared to the gaseous phase, 
it is found that the excitation peak is shifted upwards by 
1.5 eV and the total cross section lowered by 13%. The 
shift is also confirmed by quantum chemical calculations 
|48|. If we define an inelastic scattering coefficient K of 
the film by 

K = atot ■ Pn (21) 



with 1/ cos 6* being the actual path length of a /3 particle 
through the film, then the probability of scattering n times 
is given by a Poisson distribution 

P„e = e-^"i^"/n!. (22) 

At the given film thickness it is sufficient to take multiple 
scattering up to third order into account. The response 
function is obtained for each tritium film layer at a certain 
electrical potential - defined by /charge - by an appropriate 
convolution of Poisson distributions H22II over energy loss 
and path length f5H^. Running at different ©max changes 
the response function, thus requiring separate evaluation 
of runs. 

Backscattering from the graphite substrate is quite 
small. Simulations have shown that its spectrum may be 
approximated within the interesting interval of 200 eV be- 
low the starting energy E' by a constant pedestal of relative 
amplitude 

aback = 3.1 • 10-VeV (23) 

with respect to a 5- function at E' = E. The latter rep- 
resents the transmission probability for forward emission 
The number given above apphes to 6>max = 60°. 
It decreases for a narrower transmission cone of ©max = 
50° to 2.3-10^^/eV. The simulations have been checked by 
test experiments with K-conversion electrons from ssmj^j. 
decay jlBj . 

Since the back scattering effect is small it is sufficient 
to replace the exact convolution procedure by a simple 
correction factor 

/back,corr = 1 + aback(-B + eU) . (24) 

The second term stands for the integral of the backscat- 
tered spectrum over the width {E+eU) of the transmission 
window of the spectrometer. Also the folding with the en- 
ergy dependent detector efficiency in H20|l can be replaced 
by applying a simple correction factor 

/dot.corr = l + ad(-B + ei7) (25) 

with the coefficent mentioned before 

ad = (4±2) • lO^Ve^- (26) 

The fit is then performed with m?{ve),EQ, h and a 
signal amplidtude as free parameters. 

5.3 Fits of individual runs 

For all runs Q2 to Q12 fits were performed on data in- 
tervals of different spectral extension. Fig. El shows the 
resulting 'm?{v^) as function of the lower cut off of the 
accepted data interval. In some cases we observe small 
but still significant negative rn^lvf.) values. For runs Q4 
and Q7 the corresponding fit values for Eq are shown sepa- 
rately in Fig.^J Their variation relative to that of m?{ve) 
refiects grosso modo the correlation Hl()|l . 

Fig. ll3lshows in addition the reduced values for all 
fit intervals. In cases of negative or unstable m?(ve) values 
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Fig. 14. Retarding voltages at which the fit finds endpoint 
values for runs Q4 and Q7 in dependence of the fit interval. 
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Fig. 13. Fit results of rri^lve) (data points, left scale) and 
reduced (circles, right scale) for runs Q2 to Q12 in depen- 
dence of the lower limit of the fit interval. The upper limit was 
always 18.6 keV. The inner error bars correspond to the statis- 
tical, the outer to the total uncertainty (except for Q9,Q10). 
The measurements used in the final analysis are marked by a 
star. 



Fig. 15. Residua of fits for runs Q4 (upper part) and Q7 (lower 
part). The measurement points are enummerated to avoid mis- 
leading of the eyes due to unequal distances of the points. From 
left to right they correspond from 200 eV below to 100 eV above 
the endpoint Eq. 



they usually exceed 1, whereas they he in the optimal 
range for data sets with straight m?{ve) w fit results. 
This is seen more clearly in Fig. E| by the comparison of 
the residua of the straight data set Q7 and the somewhat 
distorted one Q4. 



5.4 Run selection for the final evaluation 

The high statistics of individual runs in phase II reveals 
small systematic differences between their results, which 
have been discussed in the preceding section. Since they 
fall into two clear-cut classes, clean ones and those with 
residual problems, we may select only the former ones for 
the final evaluation in order to minimize systematic devia- 
tions and uncertainties and to arrive at our optimum over- 
all result. This procedure might be considered question- 
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able if the selection were based on a negative (i^e) result 
alone; because it might then introduce a bias. But we have 
clearly shown that negative and fluctuating m^(i'e) values 
(the latter as function of the data interval) occur at unsta- 
ble running conditions, in particular with respect to back- 
ground. Hence we can well justify our choice. In this sense 
we retain runs Q5 to Q8, Qll and Q12 for the final analy- 
sis. It should be noted, that only starting with run Q5 the 
very important method of applying high frequency pulses 
to one electrode at the detector side of the spectromter 
has been used in order to clean the spectrometer from 
possibly stored particles and to stabilize the background 
rate. 

In detail Q2 had to be rejected because we had pre- 
pared an obviously too thick source from which we learned 
about the unexpected charge up effect. Here it spread 
over 6 eV, which is probably too much to be corrected 
for safely. The other 4 rejected runs suffered from small 
residual spectral anomalies of the data discussed above. 
Only in run Q4 we observed an anomaly whose signature 
was compatible with a Troitsk anomaly, i.e. a step rise in 
the integral spectrum. In this case one might follow the 
Troitsk procedure of analysis. It consists of fitting 2 addi- 
tional parameters for position and size of the step to the 
data. For distinct steps lying not too close to the endpoint 
the additional parameters decorrelate sufficiently from the 
mass parameter such that the fit yields reasonably stable 
m'^{ve) values close to zero |2H]. This is the case for Q4 
P?] (and actually only for Q4). However, we have decided 
to retain from this ad hoc procedure, since the step effect 
is neither stable nor properly understood (see also sec- 
tion 6.2). This way we facilitate at least the discussion of 
systematic uncertainties below. 

5.5 Joint analysis of selected runs 

The data from the selected runs Q5 to Q8, Qll and Q12 
cannot be simply summed up for a single fit, since they 
have been collected at somewhat different conditions with 
respect to source strength, accepted solid angle, choice of 
measuring points etc. We also have to face slight changes 
of the fitted endpoint value beyond the statistical limit of 
order 100 meV, since we cannot guarantee the stability 
of our HV equipment to that level over years. Actually 
m?[ue) is the only parameter expected to approach one 
and the same value in any correct data set. Therefore, we 
have performed a joint fit of the full data set with respect 
to only this parameter by the following procedure. We 
have first fitted each of the selected runs separately with 
respect to amplitude, background, and endpoint, and have 
calculated its as a function of the common parameter 
m^(i^e). The six curves were then added up to form a 
global curve fFig. I16|l from which the final TO^(i^e) fit 
result and its statistical error are determined. This proce- 
dure is equivalent to a common fit of all six data sets with 
3-6-1-1=19 free parameters; but it converges much faster, 
since it makes proper use of the fact that each subset de- 
pends only on three individual and one common parame- 
ter. 




Fig. 16. Determination of ■m'^{ve) from the final data set. 
Shown are the x^ plots for the parameter rn?{i/e) for the single 
data sets (different symbols) and the sum (open circles), which 
corresponds to the fit of the total data set. The fit intervals are 
restricted to a lower limit of 70 eV below Eq. 

5.6 Uncertainties of input parameters 

For most of the input parameters entering our final fit, 
we adapt the same values and systematic uncertainties as 
chosen before in ref.s '27"2^ . For the prompt neighbour 
excitation in solid T2, however, we present in addition 
a new, critical treatment below. Some uncertainties have 
been quoted in section 15.21 already. The others are dis- 
cussed in the following. 

Final states of the daughter molecule: We use 
the most recent calculation by Saenz et al. [HHI which 
have been calculated for gaseous T2 with fully satisfac- 
tory precision. In solid T2 the excitation energy of higher 
excited final states shifts up slightly with respect to the 
ground state of (T^He)"*". The effect has been estimated 
by A. Saenz j73| and is considered here with a correction 
of 0.8 eV for the second electronically excited state group 
and with 1.4 eV for the third one. This correction is also 
considered fully as uncertainty. 

Energy loss in the T2 film: Spectrum and cross sec- 
tion of energy loss have been discussed already in section 
5.2. The relative uncertainty of the latter is 5.4% which is 
added in quadrature to the one of the column density of 
individual runs according to Table 1. 

Moreover, we consider a continuously growing cover- 
age of the source by 0.3 monolayers of H2 per day. This 
number has been obtained in two independent ways j43| : 

(i) EUipsometric determination of the source thickness at 
the beginning and end of each run has revealed a growth 
of the total thickness of 0.14 monolayers per day in the 
average. Subtracting a T2 loss of 0.17 monolayers/day as 
calculated from the apparent lifetime of the source of 400 
days, yields a growing coverage by 0.31 monolayers/day. 

(ii) Evaluation of data subsets from fresh and older sources 
shows a significant trend towards negative m?{Vf.) values 
for the older ones. A coverage growth of 0.29 monolay- 
ers/day raises this dependence. The uncertainty of both 
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Fig. 18. Correlation between neighbour excitation probabil- 
ity Pnc and (Jtotpd. Each point corresponds to the centre of a 
contourplot like in Fig. 1171 calculated for particular values of 
atotpd within its la uncertainty interval (0.370 ± 0.023), indi- 
cated by the vertical lines. 



Fig. 17. Shown are contour plots oi x^{Pnc,m^{i'e)) at la, 2a 
and 3ct around its minimum value at (0.05, 0). 

results is clearly larger than their difference. Therefore the 
correction by 0.3 monolayers/day is also considered fully 
as uncertainty. 

Neighbour excitation: The prompt excitation of 
neighbours next to a decaying T2 molecule has been esti- 
mated by Kolos in sudden approximation '3^. The effect 
is due to the local relaxation of the lattice following the 
sudden appearance of an ion. A rigorous calculation of 
final states of the surrounding electron cloud is still miss- 
ing. Therefore, it is difficult to assign a proper uncertainty 
to Kolos' estimated excitation probability of Pnc — 0.059 
with a mean energy of 14.6 eV. The latter number applies 
to the excitation spectrum of free hydrogen molecules. It 
seems reasonable to raise this number by the same 1.5 eV 
by which the energy loss spectrum of electrons is shifted 
upwards (compare section lK?^ . In the same sense, the cor- 
responding reduction of the total inelastic cross section 
by 13% 0SI has been applied also to in our former 
standard analysis. Another reduction of Pnc by 11% has 
been accounted for the observed porosity of our shock con- 
densed films (see section 3.1), yielding finally Pnc — 0.046. 
This number has also been used in although it has 
been composed from slightly different factors. Since the 
shifts in excitation energy and probability, applied to Ko- 
los' calculated values, are based but on qualitative, plausi- 
ble arguments, they had entered also fully the systematic 
uncertainty. 

The large, consistent data basis available now gives 
us a handle to try a self-consistent determination of Pnc 
by treating it as an additional free parameter in a joint 
analysis of a large interval comprising data down to 170 eV 
below Eq where the inelastic components really matter. 
Fig. 1171 shows the resulting contour plot in the 
(Pnc, ^■^(I'e)) plane. Its minimum lies at Pnc = 0.050 ± 
0.016 and m'^{i'e) = (0 ± 3.3) eV^/c*, a very satisfactory 



result, indeed. It confirms our former, estimated value of 
Pnc = 0.046 within errors and lifts the former tendency 
towards slightly negative m?{ve) values for the entire data 
set (see below). 

Still this fit value of Pnc is subject to a quite size- 
able systematic uncertainty of ±0.022. It stems from its 
strong correlation to the energy loss in the film due to 
their similar effect on the spectrum. The uncertainty for 
energy losses are a combination of the uncertainty of the 
determination of the film thickness and the measurement 
of the total cross section crtot- The averaged uncertainty 
in measuring the film thickness for all accepted runs is 3% 
and the uncertainty of dtot is 5.4%. In order to determine 
the correlation of Pne and atotpd ^ we have calculated the 

contour plot of Fig. El for different values of atotpd 
and located it's minimum in the {Pncni^ )- space each 
time. The corresponding {Pnc, <7tot pd)- pairs are plotted 
in Fig. El We see an almost straight anticorrelation of 
the two energy loss contributions. The correlation trans- 
fers the uncertainty of atotpd directly into one of Pnc as 
indicated by the bars in Fig. El m'^ii'e) and are rather 
insensitive to this exchange of Utot pd and Pne- In particu- 
lar, we cannot fix Otot pd separately by the fit alone better 
than by external input. 

Self-charging of T2 film: It has been found that the 
film charges up within 30 min to a constant critical field 
strength of 62.6 MV/m (HI - It results in a linearly increas- 
ing shift of the starting potential of /3 particles through- 
out the film, reaching about 2.5 V at the outer surface. 
We have assigned a conservative systematic uncertainty 
of ±20% to that slope. 

Backscattering and detector efficiency: Both ef- 
fects are small and can be accounted for by the linear 
correction factors (|23I24|I and (|25I26|I given above. They 
may just be contracted into a single correction factor 

/backcoiT • /dcorr ~ 1 + (^back + ad){E + cU). (27) 

^ a tot pd is a measure for the scattering probability in the 
tritium film. 
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Fig. 19. Individual and quadratically summed up uncertain- 
ties of m?{ve) for the joint data set, calculated for different 
lengths of the data interval. The open squares and stars give 
the contribution of energy losses in the tritium film, the open 
circles the neighbour excitation, the filled squares the self- 
charging effect, the filled circles the final states and the open 
triangles the detector efficiency. The line with simple crosses 
shows the sum of systematic uncertainties in dependence from 
the fit interval and the line with stars gives the corresponding 
statistical uncertainty (growing). The upper most line gives 
the quadratically summed up values and has its minimum for 
18500 eV. 

In we have already assigned to ad a conservative un- 
certainty of ±2 • 10~^/eV, which is large enough to cover 
a residual uncertainty of aback as well. 

5.7 Systematic uncertainty of m?{Vf,) 

In the standard analysis the systematic uncertainty of 
m^(i^e) is calculated from those of the external input pa- 
rameters as follows: Each input parameter is shifted from 
its best value by its uncertainty and the fit to a particular 
data set is repeated. The resulting shift of the minimum 
with respect to m?{ve) is then taken as the corresponding 
systematic uncertainty of m^ive)- 

The systematic uncertainty of the joint data set is 
evaluated in the standard analysis by the same proce- 
dure. Fig. El shows for the joint data set the individ- 
ual contributions as well as the quadratically summed up 
uncertainties calculated for different lengths of the data 
interval. Obviously the statistical uncertainty decreases 
with the length of the interval whereas the systematic 
increases. The total, combined uncertainty attains a flat 
minimum of Am^^^ = 3.04 eN"^ /c^ for a lower cut off at 
E\aw = 18500 eV which is regarded the optimum interval, 
therefore. 

Summarizing, the standard analysis with the external 
input parameter of neighbour excitation probability P„c — 
(0.046 ± 0.013) yields for the optimal data interval the 
result 

m^(j^e)standard = (-1-2 ± 2.2stat ± 2.1syst) cV^/c''; 

xVd.o.f. = 208/195.(28) 



Here the uncertainties of the externally chosen, indepen- 
dent parameters Pnc and (Jtotpd contribute to that of m^(t'e) 
by an amount of 

Sm\i^e)systMPnc, Ttotpd) = 1.59 eV^/c\ (29) 

Using the self consistently fitted Pnc value instead, we 
have to take into account that its systematic uncertainty 
of ±0.022 is anticorrelated to the corresponding uncer- 
tainty of =f0.023 of atotpd according to Fig. El Their 
combined action on m^{ve) has to be calculated, therefore. 
Moreover, we have to consider the statistical uncertainty 
(JPno.stat = ±0.016 which results from the fit in Fig. El 
Added in quadrature to the systematic contribution we 
obtain from the self consistent analysis for the optimum 
interval E > 18500 eV a combined systematic uncertainty 
of 

(5m^(j/e)s.vst,sclfcons.(^'nc,0-tot/0rf) = 1-58 cV^/c^. (30) 

The marginal reduction compared to H29|) would not re- 
ally be worth the effort. Rather we emphasize that it de- 
termines for the first time the probability of neighbour 
excitation from the data themselves and confirms, more- 
over, the qualitative estimation of correction factors ap- 
plied earlier to Kolos' original calculation of Pno P^ . 

In addition the slight shift of the central value of Pne 
from 0.046 in the standard analysis to 0.05 in the self- 
consistent one causes a corresponding shift of the TO^(j^e) 
fit value of the final result still closer to zero 

m^(ue) = (-0.6 ± 2.2,tat ± 2.1sy.t) eV^/c^ 

xVd-o.f. = 208/194 (31) 

6 Discussion of results 
6.1 Experimental f3 spectrum 

We start the discussion by taking a look at the measured 
spectra in the vicinity of the endpoint (Fig. l20|l . The bulk 
of phase II data has been obtained in runs Q5 to Q8 under 
almost identical conditions and may hence be composed 
here to a single spectrum (full squares). The open squares 
represent runs Qll and Q12. The rate is shghtly higher 
and the background still lower than in the Q5 to Q8 runs. 
For comparison we also show the last spectrum from phase 
I taken in 1994 (open circles) 26,59 . The full curve is a 
fit to the Q5 to Q8 data with m?{ve) fixed to zero, look- 
ing perfect. Already 5 eV below the efi'ective endpoint the 
spectrum rises distinctly from the background, excluding 
prima vista any larger neutrino mass. (The shift of the 
effective endpoint from the true one is obtained from an 
average over the ro- vibrational excitation of the daugh- 
ter molecule, over the transmission function, and over the 
source charging). Moreover, these summed up data ex- 
clude safely any steady spectral anomaly close to the end- 
point on the level of 1 mHz; this corresponds to about 
10^^^ of the total decay rate of the source. 
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Fig. 20. Averaged count rate of the 98/99 data (filled squares) 
with fit for m^{i'e) = (line) and the 2001 data (open squares) 
in comparison with previous Mainz data from phase 1 (open 
circles) plotted as function of the retarding potential near the 
endpoint Eq. 



6.2 Troitsk anomaly 

The absence of any anomaly in the summed up spectrum 
does not exclude necessarily a step like Troitsk anomaly 
which would fluctuate in position and amplitude. It might 
be washed out in the summed up data. Indeed it has been 
observed to be a fluctuating effect, for some time hinting 
to a half year period even ^28 . In December 2000, how- 
ever, it appeared as sudden outburst [TJ- In this period 
QIO was running at Mainz in parallel. Fig. 1211 shows the 
analysis of both runs with respect to the appearance of a 
step in the integral spectrum, i. e. a line in the original 
spectrum. To that end one fits the spectrum to the data 
under the assumption of an additional sharp line of free 
amplitude at a particular position. The upper plot shows 
the course of function of the line position for the 

Troitsk data. A very significant minimum is observed at 
18553 eV indicating a line, (or step, respectively) with an 
equally significant amplitude of 13 mHz (middle plot). The 
corresponding plot for the parallel run at Mainz with 
similar sensitivity shows but fluctuations of statistical size 
(lower plot). Hence speculations that the Troitsk anomaly 
might be due to a fluctuating presence of dense neutrino 
clouds I2HI are disproved. Rather it has to be attributed 
to instrumental effects, as pointed out already in section 
4.2 (see also 36 and 44 ). 



6.3 m/^{ve) result and upper limit of m{ve) 

From the two alternative choices of the neighbour exci- 
tation probability we settle on the self-consistently deter- 
mined one for reasons given in sections 5.6 and 5.7. Hence 
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Fig. 21. Search for a step like anomaly in parallel measure- 
ments in december 2000. The upper and the middle graph show 
the analysis of the Troitsk data |74| by adding position and am- 
plitude of the step as free parameters. The upper graph shows 
the resulting drop of x^y the lower one the fitted step ampli- 
tude, both as function of the step position. A very significant 
signal appears around 18553 eV. In contrast the corresponding 
plot for the Mainz data (lower graph) is shown, fluctuations 
are insignificantly by only 2 units. 



(|31|l is our final experimental result on the observable 
rn^^Ve)- As compared to our ealier communicated result 
[22! it improved in three respects: 



The statistical uncertainty has been diminished further 
by 0.3 eVVc*. 



20 



Ch. Kraus et al.: Final Results from the Mainz Neutrino Mass Experiment 









4 1 


T 






1 




1 

i ' 


r-" 

▼ BEJING 

A LIVERMOORE 

A LOS ALAMOS 

■ MAINZ 

□ TOKYO 

• TROITSK 

O TROITSK step -'cn 

O ZUERICH 



1990 '992 '99^ 1996 1998 2000 2002 200^ 



yea r 

Fig. 22. Published results of squared neutrino mass values 
m^{ue) obtained from tritium decay since 1990. The already 
finished experiments at Los Alamos, Zurich, Tokyo, Beijing 
and Livermore |76I77I7 8 79 80 used magnetic spectrometers, 
the experiments at Troitsk and Mainz are using MAC-E-Filters 
(as described before). 

2. The systematic uncertainty has been better founded 
with respect to the questionable neighbour excitation 
probability (but remained unchanged in size). 

3. The central value has moved further up from -1.6 eV^/c^ 
to -0.6 eV^/c^ and has lost by now any touch of being 
unphysical in view of the error bars. 

The progress in the observable m?{ve) of this final Mainz 
result as compared to the most sensitive earlier experi- 
ments using momentum analysing spectrometers approaches 
2 orders of magnitude fFig. 122(1 . The Troitsk group com- 
municated similar numbers 75 {rri?{ve) = (— 2.3±2.5stat± 
2.0syst) eV^/c"*), but there is an important difference. The 
Troitsk group needs to correct for the observed anomaly 
by adding phenomenologically a sharp line with free posi- 
tion and size to the (3 spectrum without including a sys- 
tematic correction for this approach. Without this correc- 
tion the fit would charge this effect on rn?{ve) and drive it 
negative as discussed above already. Since phenomenology 
and origin of the anomaly are barely known, this proce- 
dure is not obvious and it is difficult to assign a proper 
systematic uncertainty to this correction. Up to now the 
Troitsk group has not considered in its result any system- 
atic uncertainty of this correction. 

If we move the central value of m?[ve) to zero and 
calculate from there the upper mass limit at 95% C.L., 
then we obtain the so-called sensitivity limit. It lies for 
both evaluations H28|) and H31|l at 

m,e„s. iim.(i^e) = 2.4eV/c2 (95%C.L.). (32) 

Since the actual m?{ve) values are slightly negative we 
derive from them an upper limit by help of the unified 
approach |81j . recommended by the particle data group. 



This yields in case of the result ((28|l from the standard 
analysis 

m{ve) < 2.2 eV/c^ (95% C.L.) (33) 

which agrees with the latest communicated value [211 ■ 
Our preferred result (|^ . however, calculated with a self- 
consistent Pne value, yields a slightly higher limit 

m{i^e) < 2.3 eV/c^ (95% C.L.) (34) 

since the respective m'^{i'e) value lies still closer to zero. 
The increasing reduction of the upper limit below the sen- 
sitivity limit as function of an increasing negative rin?(Vf.) 
value, is but a dubious gift of the unified approach, ac- 
companied by an increase of the probability that the re- 
sult suffers from unidentified systematic errors. We quote 
instead of (p!^ or as our final upper mass limit, 
because it stems from a more consistent analysis of the 
data on one hand and conforms to the recommended uni- 
fied approach on the other. Anyway, their difference is 
marginal. 

7 Conclusion and outlook 

Phase II of the Mainz neutrino mass experiment started in 
1995 with substantial improvements regarding the frozen 
T2 source as well as background rejection in the /3 trans- 
port channel and in the electrostatic spectrometer. This 
enabled running at a 10 times better signal to background 
ratio from 1997 on. Thereafter, a number of side experi- 
ments yielded: 

1. A detailed study and suppression of the unexpected 
and disturbing dewetting of the T2 film from the sub- 
strate jl^llTTj . 

2. The discovery, quantification and theoretical explana- 
tion of source charging "71". 

3. A determination of the energy loss spectrum of /3 par- 
ticles in sohd T2 jH]. 

4. Phenomenological studies and suppression of background 
mechanisms in MAC-E Filters. 

They formed the basis for a satisfactory control and re- 
duction of systematic uncertainties in parallel to the sta- 
tistical one. 

Data taking on the search for the neutrino mass cov- 
ered the years 1998 to 2001 and yielded the so far narrow- 
est limit on the observable m?{ve) of (—0.6 ± 3.0) eV^/c"* 
from which an upper limit m(z^e) < 2.3 eV/c^ (90% C.L.) 
is derived. 

The discovery of neutrino oscillations at squared mass 
differences of Amf^- < 0.05eVVc^ [m^ TTTTYTTlTT)] 
allows furthermore to apply the same upper limit to all 
three neutrino flavours as reference value in particle and 
astrophysics. Clearly there is a burning interest to improve 
this limit further in order to check cosmological models 
more sensitively by laboratory results on one hand and 
to decide the alternative between degenerate and hierar- 
chical neutrino masses on the other. In this respect a re- 
cent paper on the final data from the Heidelberg Moscow 
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experiment is giving a first indication; it reports on a 
4(7 signal of neutrinoless double (3 decay in ^^Ge 
Explained by an exchange of a massive Majorana neu- 
trino, this signal would give a mass in approximate limits 
0.1 < TTiee c^/eY < 0.9 (95% C.L.). 

Obviously our present experiment has exhausted its 
potential by now, almost 20 years after it has been first 
conceived. First plans to build either a rigorously enlarged 
MAC-E-Filter (TOj, or a bent variant offering in addition 
a highly resolving differential energy analysis j82) were 
proposed at an Erice meeting in 1997. A following paper 
treated in some detail the potential of a MAC-E-Filter of 
5 m diameter and reported moreover on an implementa- 
tion of a time of flight mode which transforms a MAC- 
E-Filter from a high pass to a narrow band filter with 
equally sharp slopes 68 . In 2000 the KATRIN collabora- 
tion |S7] formed proposing to build a large MAC-E-filter 
in combination with a gaseous T2 source at the site of 
the Forschungszcntrum Karlsruhe. It combines the exper- 
tise from the foregoing experiments at Los Alamos TJ, 
Mainz and Troitsk with the strength of a national labora- 
tory including expertise in handling large amounts of tri- 
tium. The present design aims at reaching within 3 years 
of measurement a precision of Am^{i^e) ~ 0.02eV^/c^ cor- 
responding to a sensitivity limit of 0.2 eV/c^ for the mass 
itself. The experiment should be ready to go in 2008. 
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